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1 ITERATIVE MMSE EQUALIZATION-DECODER SOFT 

2 INFORMATION EXCHANGE DECODING METHOD AND DEVICE 



3 FIELD OF THE INVENTION 

4 The present invention concerns the field of decoding of information symbols 

5 received over a channel. 



6 BACKGROUND OF THE INVENTION 

Information symbols are transmitted over channels in most information, storage 

fi8 and communication devices. The channel can comprise, for example, a wired or wireless 

^9 communication link between a transmitter or receiver, or an information path within a disk 

fUO drive. More generally, any information path of limited bandwidth through which digital 

Ml signals are transmitted may be defined as a channel. Such channels are subject to various 

f§2 types of distortion, e.g., additive noise and intersymbol interference. These distortions limit 

[J3 the data rate efficiencies for communication over such channels. Accordingly, much effort 

4}4 has been devoted to reducing the effect of such distortions in the channels. The obvious end 

05 goal is to decode symbols accurately. More specifically, the goal is to have low decoding 

16 error rates. A second and conflicting goal is to increase the ratio of data symbols to total 

17 channel symbols transmitted, i.e., the data rate. 

1 8 Recent focus for joint equalization and decoding has been on iterative decoding 

19 schemes, and in particular, turbo coding schemes. These schemes are confidence building 

20 schemes in which an equalizer and decoder trade soft information in the form of symbol 

21 estimates until convergence is reached and hard decisions for symbols are output. These 

22 iterative schemes treat the channel contribution like an error correction code. The data 
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1 symbols are generally permuted before transmission and are typically protected with a 

2 convolutional error correcting code. On the decoding side, soft information is exchanged 

3 between an error correction decoder and a channel decoder. However, all current 

4 implementations of these soft information exchange schemes use a forwarc^ackward, 

5 Viterbi, or similar decoding algorithm for the decoding function. Specific examples are the 

6 forward/backward and soft output Viterbi algorithm for convolutional codes. In such 

7 decoding schemes, the complexity of the decoder is a design choice, but the complexity of 

8 a trellis based equalizer is a function of the length of the channel impulse response. This 

9 limits practical usefulness of the conventional decoding schemes to a class of channels 

10 having reasonably short impulse response lengths or small signal constellations. 

1 1 The complex nature of conventional equalizing schemes in soft input exchange 
r§2 methods and devices also places certain physical limitations on devices which rely on such 
13 methods and devices for channel decoding. For example, there exist no solutions beyond one 
pj4 dimension for forwarc^ackward and Viterbi algorithms. This dictates a one dimensional 
W5 data stream, such as the stream obtained by a magnetic disk drive head or an optical disk 
si 6 drive. There is no significant physical reason for restriction to one-dimensional streams of 
Jl7 data, but an as yet insurmountable hurdle for extension to higher dimensions is the lack of 
3(8 higher dimensional forwarc^ackward and Viterbi algorithms. A decoding method with 

9 multi-dimensional decoding capability would free devices from the requirement of creating 

20 a one dimensional stream of data. For example, two dimensional regions of disk drives could 

21 be read simultaneously if two dimensional channel decoding is supported. The 

22 forward/backward and Viterbi algorithms used for data decoding are unable to handle the 

23 multidimensional task since multidimensional solutions are unknown. 

24 Accordingly, there is a need for an improved method for decoding data 

25 received over a potentially noisy channel which addresses some or all of the aforementioned 

26 drawbacks. It is an object of the invention to provide such an improved method. 
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1 SUMMARY OF THE INVENTION 

2 These and other needs and objects are met or exceeded by the present iterative 

3 MMSE equalization-decoder soft information exchange decoding method and device. The 

4 method uses a MMSE equalizer which receives and outputs soft information. The equalizer 

5 exchanges soft information with a soft information decoder. The simple nature of the 

6 equalizer permits solutions beyond one-dimensional data streams and for channels of 

7 arbitrary length and for signal constellations of arbitrary size. 

8 BRIEF DESCRIPTION OF THE DRAWING 

9 Other features, objects and advantages of the invention will be apparent to 
10 artisans from the detailed description and the FIGURE, which is a block diagram of a data 
Jjl communication system including an iterative MMSE equalization-decoder for soft 
^2 information exchange decoding. 

ft E 

§i DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

=1 4 The invention is directed to a method for data recovery by confidence building. 

£§5 The invention is applicable, for example, to communications, telephony, recording, data 

JJ6 transmission, and restoration. For example, even when the data has not been protected by 

1-3 s 

!±7 an error correcting code, there may be other opportunities for confidence building decoders 

18 to operate. Suppose that the data were transmitted over multiple channels to the same 

19 receiver. This might arise when a preferred user in a cellular telephone system was given 

20 two or more cellular phone channels (for example multiple time-slots in a time-division 

21 multiple access scheme, multiple frequency slots in a frequency-division multiple access, or 

22 multiple spreading codes in a code division multiple access scheme), it might include storing 

23 the information on a data recording device multiple times (modular redundancy), or a 

24 receiver that has multiple antennas which can receive the same data at multiple locations. 
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1 According to the invention, even without error correction coding, a confidence building data 

2 recovery system may be constructed, in which equalizers for each of the different channels 

3 exchange their beliefs, or estimates, of the data, until a consensus is achieved. A typical and 

4 more general case arises when there is one or multiple channels over which data is sent, and 

5 the data is protected by an error correction code, likely different for each channel, before 

6 being sent over each channel. 

7 The generality of the confidence building data recovery method of the 

8 invention will be apparent to artisans. The method will be illustrated with reference to an 

9 error correction coded communication channel. An exemplary communication system 

10 including such a channel is shown in FIG. 1 . 

1 1 For simplicity, we consider transmission of binary digits b { using a Binary 
S2 Phase Shift Keying (BPSK) modulation scheme. Artisans will understand that the invention 
J3 is readily generalized to other modulation schemes. We assume that the bits bj are encoded 
M4 in a forward error correction code C (typically a convolutional code), by an encoder 10, and 
55 that the bit stream is permuted by a suitable (e.g. random) interleaver 12 before the 
46 transmission. 

ft7 The encoded symbols are denoted a^ II is a permutation of the bits a ^ The 

gfe8 transmitted signal may be expressed as 

m 5(0 = £ b ft M {t - iT)exp(j(2TZf 0 t + 4> o )) 

20 where f 0 is the carrier frequency and (j) 0 is a constant angle. The received signal equals 

21 x(t) =£ bhJt-iT)exp(j(2nf 0 t + <b x )) + w(f), 

i 

22 where 4>! is a constant angle and w(t) is an additive noise term. In addition to intersymbol 

23 interference, a channel 16 typically also adds a noise component. The signal x(t) is 
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1 demodulated, passed through a receiving filter and sampled leading to the equivalent 

2 discrete-time model of the communication link which is depicted in FIG. 1 . 

3 x[u]=J2bJi{n-i\+w[n] 9 

i 

4 where h[j] are the sampled values of the overall impulse response of the communication 

5 system. 

6 A discrete-time model of the channel 16 with intersymbol interference and 

7 additive noise w n is described as 

ft x[n] =b n h[0] +w[u] + £ bh[n -/]. 

ftj9 where the term Y,\ bih[n - i] is usually referred to as intersymbol-interference. 

1ft) We note that the received sampled signal x[n] is a noisy version the 

%\ convolution of the bit-sequence with the overall impulse response. In particular, for a finite 

52 length impulse response h[j] the sequence x[n] can be represented as a noisy output of a 

H3 Markov process. The task of estimating symbols b { in the absence of a coding constraint is 

£§4 referred to as equalization. The invention concerns joint decoding and equalization of the 

15 bit-stream x[n] in an iterative decoder 20 having a soft MMSE equalizer 22 exchanging 

16 information with a soft decoder 24. 

17 It is well known how to optimally estimate b n from the sequence x[n] using the 

18 so-called forward/backward algorithm. However, the complexity of this approach is usually 

19 impractical because the complexity is essentially the product of the complexities of an 

20 optimal decoding procedure and an optimal equalization only procedure. The complexity of 

21 an optimal equalization only procedure grows exponentially in the length of the overall 
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1 impulse response, which, for practical channels with impulse response lengths in the tens to 

2 hundreds, is infeasible. 

3 Iterative (Turbo) decoding and equalization uses at least two soft input/soft 

4 output (SISO) devices that communicate information. A SISO equalizer takes as input the 

5 received sequence x[n] and some additional information about the symbol sequence fy. This 

6 additional information could for example be a prior probability on the bits. The SISO 

7 equalizer produces a soft estimate of the symbols. This soft output could for example be a 

8 probability mass function indicating the likelihood of any symbol b { being equal to 0 or 1. 

9 A second SISO block performs the decoding of the estimated bit sequence with 

10 respect to the code. In other words the soft input decoder takes as input reliability 

1 1 information (typically a probability mass function) and produces as soft output a probability 
yfe mass function indicating the likelihood of any symbol b { being equal to 0 or 1 . The input 
J3 reliability information for the equalizer (decoder) is denoted tc£(7i£). The output of the 
3:4 devices is denoted as K out (K out )- For an overall channel impulse response h[j], let the 

i >-ji 

?|5 received values x[n] and reliability vectors 7i in [n] n = 1 . . . N be given. Without loss of 

si 6 generality we assume that 0 < n in [j] < 1 for all j e {0 . . . N} . (The 7i in [j] can be thought of 

id 

rJ7 as prior probabilities). 

58 We define a SISO equalizer mathematically as a device that performs an 
equalization function eq : M N x [0, 1] N [0, 1] N eq(y, K E iT )»ii E 0uO where n E 0Ut can be thought 

20 of as a vector of a posteriori probabilities. 

2 1 Similarly, we mathematically define an SISO decoder as a device that performs 

22 a decoding function dec: [0, 1] N -> [0, 1] N dec(ir£)~7tf u , , where n D out can be thought of as 

23 a vector of a posteriori probabilities. 

24 The main idea of conventional iterative joint equalization and decoding is to 

25 let the two SISO blocks exchange information until they agree on a decision or until a 

26 maximal number of iterations is reached. As soon as the predetermined termination criterion 
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1 is satisfied, the output and the input of the SISO decoder are combined in order to form a soft 

2 combined equalization decoding decision. If desired, a hard decision on any symbol can be 

3 derived from this soft value. 

4 Typically after a suitable number of iterations the output of the joint equalizer 

5 decoder is formed by multiplying the values of the likelihood ratios tt^/(1 -nf tt ) and 

6 <„/(!- <,,)• 

7 In order to achieve good performance in such an iterative scheme, a 

8 permutation is included in the data path, which spreads out statistical dependencies between 

9 estimates. The exchange between decoder and equalizer establishes an inherent feedback 

10 loop. It is important that this feedback be mitigated as much as possible. We say that an 

11 equalizer (decoder) is well-behaved if n E out \j] is not a function of 7iJ[/] (rtfj)"] is not a 
Ji2 function of 

15 We now can describe the iterative equalization/decoding scheme in the 

jjH following algorithm: 

i w 

Sj5 1 . INPUT: A permutation II, a vector of received values y, and prior 

4? EE 

h16 information about the symbols expressed as a vector of probabilities K in (it in is usually a 

ji7 vector containing a value 0.5 in each position.) 

jj8 2. Repeat the following steps until a termination criterion is reached. 

§9 (a) *L = eq(y,-K B in ) 

20 (b) < = II-'CtO 

21 (c) K D out = dec(n°) 

22 (d) < = HO 

23 (e) If the termination criterion is not satisfied go to step 2a. 

24 3 . OUTPUT hard decisions for symbol b { comparing 

25 to 1. 
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1 Iterative joint equalization and decoding schemes can be compared on the basis 

2 of the above algorithm and various combinations of decoding functions and equalization 

3 functions have been reported on. As decoding functions we explicitly mention the forward- 

4 backward and the SOVA algorithm for convolutional codes. Adaptations of these algorithms 

5 have been employed in the equalizer function. However, while the complexity of the decoder 

6 is a design issue, the complexity of a trellis based equalizer is based on the length of the 

7 channel impulse response. This severely hampers practical use of iterative equalization 

8 decoding techniques based on the turbo principle. For channels with long impulse responses, 

9 the exclusively used equalization techniques are either linear equalization or decision 

10 feedback techniques without use of the decoder in the equalization process. The invention 

1 1 solves this problem by providing an equalization algorithm independent of the length of the 
Jj2 channel impulse response that can be used in iterative decoding. In particular, a minimum 
J3 mean square error equalizer is demonstrated by the invention to facilitate joint decoding and 

equalization. The iterative technique of the invention is applicable to channels with a short 
or long impulse response, and with small or large signal constellations. 

46 Let b[n] be a sequence of symbols that have been transmitted through a 

lB7 communications channel, such as a wireless or wireline data link, or recorded onto some data 

ffe8 recording medium, such as an optical ROM or magnetic disk or tape. A linear, equivalent 

Jl9 base-band model for the received (or read-back) sequence of symbols is given by 

20 x[ri] = £ h[k]b[n -Jfc] + w[n], 

21 where h[k] is the length Lj + L 2 + 1 impulse response of the channel, and w[n] is an additive 

22 noise term modeling electrical and thermal fluctuation and undmodeled components of the 

23 channel. This generic linear model is a widely accepted mathematical model for the 
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distortions induced on a sequence of symbols both in communications and data storage 
applications. A linear equalizer for this channel can be used to attempt to reduce the effects 
of the intersymbol interference and the additive noise induced by the channel. A linear 
(affine) equalizer with coefficients c[n, k] and offset g[n] and symbol estimate b [n] can be 
expressed in the form 



where the equalizer coefficients are written as a function n to enable the possibility of 
different coefficients used to estimate each symbol b [n], and the offset g[n] provides a richer 
class of linear estimates which can account for a non-zero mean prior. The channel model 
can be written in matrix form as 



*2 

b[n]=J2 c[n,k]x[n+k]+g[n], 



x[n] = HB[n] + w[n], 
where the channel response matrix, H, is given by 



h[L 2 ] h[L 2 -l] 



0 



0 



0 



h[L 2 ] h[L 2 -l] 



h[-L x ] 



0 



0 



0 



h[L 2 ] h[L 2 -l] • h[-L x ] 



and the signal vectors are given by 

x[n] = [x[n - N, . . . x[n] . . . x[n + N 2 ]] T , 
B[n] = [b[n - N, - L 2 ] . . . b[n] . . . b[n + N 2 + L,]] T , 



1 w[n] = [w[n - NJ . . . w[n] . . . w[n + N 2 ]] T . 

2 The equalizer output can also be expressed in matrix form, simply as 

3 *[n] = c[n] T x[n] + g[n], 

4 where the equalizer coefficients c[n,k] are written 

5 c[n] = [c[n,-N 1 ] 5 ...,c[n,N + 2]]. 

6 With this channel model, the mean-square error of a symbol estimate b[n] based on the 

7 estimate b[n] is given by 

8 E{\b[n]-b[n]\ 2 }, (2) 

9 where the expectation is taken over the distribution of the symbols b[n] and the noise w[n]. 
10 In the conventional traditional approach to the design of complexity-constrained (finite Nj 
M and N 2 ) minimum mean-square error (MMSE) linear equalizers, it is assumed that the 

;>: 

J2 symbols b[n] are equally likely to take on all possible symbol values, and that there is no 

5p additional information about their values available. The conventional equalizer is determined 

44 by finding the coefficient values c[n] and g[n] which minimize the mean squared error (2), 

=15 which, since the symbols are assumed unknown and equally likely for all time n leads to a 

W6 single set of coefficients, c, and the offset is given by g[n] = 0. 

fh7 According to the invention, the equalizer 22 implements an equalization 

S8 algorithm which has available a set of priors over the symbols. For example, if the symbol 

19 alphabet is binary, then this would correspond to the availability of the sequence 7t*[w] = 

20 Prob {b[n]=l } . In the sequel, we assume that the channel response h[n] is real and that the 

21 symbol alphabet is b[n] e {-1, 1} for simplicity. Extension to complex baseband channels 

22 and higher-order symbol constellations is straightforward. In this case, the MMSE equalizer 

23 22 can be designed incorporating these priors into the optimization. Hence, the equalizer 

24 coefficients, c[n] and g[n] can be determined by finding the minimum of the mean-squared 

25 error (2), where the expectation in (2) is over both the additive noise in the channel, and the 
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given (time- varying) prior over the symbols. As a result, the equalizer coefficients will vary 
with time index, n. This leads to the following formulation, 

b[n] = E{b[n]}+[E{b[n]B[n]}H T -:fe{b[n]}E{B[n] T }H T ] 

[HE {B[n]B[n] T } H T + E{ | w[n] | 2 }I - HE {B[n] } E {B[n] T } H 7 ] -1 (x[n] - HE{6[n]}). 
Once the equalizer has produced MMSE linear estimates of the symbols b[n] , these 
estimates must be mapped into priors 7if u/ . One method for mapping the outputs of the linear 
equalizers is to assume the output distribution b[n] is conditionally Gaussian, distributed 
about the symbol values. This leads to the following mapping 



Prob{b[n]=l\b[n]} = 



1 



1 +tanh 



b[n] 



o. 



* / 



where o\ is the variance of the conditional output distribution given the symbol b[n] = sign (6 [«]). 

b 

In order for this equalizer to be considered well-behaved, the estimate b[n] cannot be a 
function of n E in [n]. Hence, the expectations must be taken over a distribution of the symbols 
which excludes ^[n] for the calculation of b[n]. However, in calculating b [k], k * n, 
Ti^[n] may be used. This leads to the following method for computing the output 
distribution given the observations, x[n] and the input distribution ti in . 



CREATE BUFFERS 

1 . Create buffers for the priors, the signal x[n], the expectations bb W = 
E{b[n]B[n]}, the correlation matrix B[n] = E{B[n]B[n] T }, and the means M = E{B[n]} 

7t("> a [n<»>[-N, - L 2 ], . . . , ir (n) [0], . . ., ir< n >[N 2 + L,]] T 

X (n) 4 [xWf-N,], . . ., x<">[0], . . ., x< n >[N 2 ]] T 

£ b (n > A[bb( n )[-N, - L 2 ], . . ., bb(">[0], . . . bb< n >[N 2 ]] T = [0, . . . 0, 1, 0, . . ., 0] T 



1 2. Initialize buffers for priors rc (n) and data x (n) , in terms of the signal x[n] 

2 and the input n IN . 

3 x^=[0,0,...,x[0],x[l],...,x[N 2 ]] T 

4 7t«» = [0, 0, . . ., 0, <[0], . . . , <[N 2 + L,]] T 

5 3. Loop over the data for n= 0, . . ., N: 

6 7t (n) [0] = l A 

7 w V n > = 2 7t (n) -l 

9 diag(B) = diag(l,l,..., 1) 

10 c[n] = [H (B - w V"> m V n) W +o 2 J] l Hb b M 

U b[n] = m V"> + c (n)T (x (n > - H ~ b ^) 

m x (n+1) = [x (n) [-N, + 1], . . . , x (n) [N 2 ], 0] 

P rc< n+,) = [7t (n > [-N, - L 2 + 1], . . . , n< n > [N 2 + L,], 0] 

p if n < N - N 2 

J5 x (n+I) [N 2 ] = x[n + 1 + N 2 ] 

JL6 ifn<N-N 2 -L, 

W7 7t (n+1) [N 2 + L,] = n E IN [n + 1 + N 2 + L,] 

QD8 4. Estimate output variance o 2 g = (yar(b\ b>0) + var(b\b<0))/2 

39 5. Determine output priors, t^o UT = 1/2 (1 +tanh (-^^-)) 

20 SOFT-INPUT SOFT-OUTPUT DECISION FEEDBACK EQUALIZATION 

2 1 For a minimum mean-square error (MMSE) decision feedback equalizer, the 

22 channel model can be written in similar matrix form to the MMSE linear equalizer, 
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where, for simplicity of notation, it is assumed that the number of decision symbols feedback 
to the equalizer is given by M = N, + L 2 , for 3[n] = [d[n-l], . . ., d[n -M]]. For binary 
antipodal signaling, d[n-k] = sign (b [n-k]), and for higher order signaling constellations, a 
suitable quantizer to the nearest symbol would be used. 

The MMSE DFE coefficients are then given by 



b[n]=E{b[n]} + 



E{b[nf b [ri\}H T - E{b[n]E{l[n] T }H T \ 0 UM ] 



HE{l[n]i[nf}H T +E{v,[n?}I-HE{imE{l[n?)H T HE^ 

E{dMl[nf}H T +E{dlnl)E{1[nf}H T EQ[n] d [n\ T ) -E{ d [n]}EQ[n]} T 



x[n] -HE{j[n]} 
din] ~E{ d [n]} 



When this MMSE DFE is made well-behaved, we set E{b[n]} = 0, which, together with 
some algebra, reduces this expression considerably, to 

b[n]=E{b[n]i[n] T }H T [HE{l[nMnf}H T +E{ W [n] 2 }I-HE{l[n]}E{l[nf}H T - 
(HE{l[nUnf) -HE{l[n]}E{ d [ n ] T })E{ d [r,Mn} T )-\E{ d [nMn] T }H T -E{d[n)}E{l[n] T }H r )]"' 
Q[n] -HE{l[n]) -i.HEC b [n] d [n] T ) -HE{l[n]}E{ d [n] T })EQ[nMn] T }- l Q[n] -EQn]})\ 
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1 The preferred implementation of the present invention is shown in the 

2 FIGURE. In the FIGURE, a process for encoding/transmission and reception/decoding 

3 begins with a set of digital data, depicted as data bits a^ These data bits are then encoded, 

4 using forward error correction coding 10, to produce the encoded sequence of bits, depicted 

5 as d r 

6 The encoded data bits are now interleaved (re-ordered) in time using the data 

7 interleaver 12. The purpose of the data interleaver is to re-order the data such that the 

8 statistical dependencies between the data bits are spread out in time. This makes adjacent 

9 data bits in the re-ordered sequence, b { in the figure, approximately independent of one 

10 another. The re-ordered bits b { are now ready to be transmitted over the channel 16. The 

1 1 process of mapping the bits b { into channel symbols and transmitting them over the channel 
52 is depicted in the FIGURE as block 16. The ISI channel 16 introduces distortion into the 
jb3 sequence of channel symbols. The channel 16 also is assumed to exhibit additive noise, as 
^4 depicted in the FIGURE. The output of the channel 16, is then the sequence of corrupted 
s ^5 channel symbols, x[n]. The received sequence x[n] is then processed by the receiver block 
!16 20 to remove effects of the channel. The receiver block comprises several elements. 

Wl First, the received data symbols are equalized using a soft-input/soft-output 

Efi8 MMSE equalizer 22. The equalizer 22 attempts to eliminate the intersymbol interference 

J9 (ISI) from the channel. The output of the equalizer 22 is a set of priors, or confidence levels, 

20 in the symbol values, labeled as IIq UT * n ^ e fig 111 " 6 - The two inputs to the SISO MMSE 

21 equalizer 22 are the channel output symbols x[n] and a set of confidence levels in their 

22 values, 11^ . On the first pass through the equalizer, an initialization set of confidence levels 

23 are used, which are equally-likely to take on all values. Subsequent passes use confidence 

24 levels produced by the SISO decoder 24. 

25 The confidence levels are then re-ordered using the de-interleaver 12a to place 

26 them in the same order as the corresponding bits in the encoded sequence a,. The confidence 
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levels can now be used in a soft-input/soft-output decoder 24 to produce estimates of the 
original uncoded data bits a i? labeled as II^ UT in the figure. The confidence levels over the 
sequence aj are then interleaved 12 again, back to the ordering of the channel symbols and 
the interleaved data bits bj. The confidence levels are now used as input to the SISO MMSE 
equalizer 22, together with the data x[n]. Whereas in the first pass through the equalizer 22, 
the confidence levels were arbitrarily preset to initialized values, now the confidence levels 
have been determined by the decoding process. This cycle is repeated until either a 
convergence criteria is met, or a sufficient number of passes over the data have elapsed. 
Typically, the convergence criteria will consist of a prespecified measure of match between 
the confidence levels determined by the decoding process and those determined by the 
equalization process. Other possible convergence criteria could include testing that the 
confidence levels determined by one or the two SISO devices have not changed appreciably 
over a sequence of passes. 

While various embodiments of the present invention have been shown and 
described, it should be understood that other modifications, substitutions and alternatives are 
apparent to one of ordinary skill in the art. Such modifications, substitutions and alternatives 
can be made without departing from the spirit and scope of the invention, which should be 
determined from the appended claims. 

Various features of the invention are set forth in the appended claims. 
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